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Over the last years, a great deal of attention has been focused on complex networked systems, 
characterized by intricate structure and dynamics [1 6j. The latter has been often represented in 
terms of overall statistics (e.g. average and standard deviations) of the time signals [Ij. While such 
approaches have led to many insights, they have failed to take into account that signals at different 
parts of the system can undergo distinct evolutions, which cannot be properly represented in terms 
of average values. A novel framework for identifying the principal aspects of the dynamics and how 
it is influenced by the network structure is proposed in this work. The potential of this approach is 
illustrated with respect to three important models (Integrate-and-Fire, SIS and Kuramoto), allowing 
the identification of highly structured dynamics, in the sense that diflferent groups of nodes not only 
presented specific dynamics but also felt the structure of the network in different ways. 

Given that complex systems are almost invariantly composed by a large number of interacting elements, they can 
be effectively represented and modeled in terms of complex networks OH]. With this mapping, their structural and 
dynamical properties can be extracted and investigated. Typically, the structure of such networks is quantified in 
terms of several measurements [3], reflecting different properties of the respective topology (e.g. node degree, shortest 
paths, centralities) and geometry (e.g. arc length distances, angles, spatial density). 

A great deal of the investigations about structure and function in complex systems has focused on trying to predict 
the dynamics from specific structural features [U [101 HI] • Such an ability would provides the means for effectively 
controlling real-world systems. Despite the growing number of works devoted to this problem, the knowledge about 
the relationship between the structural and dynamical properties remains incipient because of two main reasons: 
(a) dynamics is often summarized in terms of global statistics, overlooking the intricacies of dynamics; and (b) the 
investigation often focuses on linear relationships such as correlations between structural and dynamical features. 

The present work is aimed at addressing these limitations through a comprehensive and systematic procedure, 
involving three steps described as following. First, we use the multivariate statistical approach known as Principal 
Component Analysis (PCA) |12j in order to identify the most important features of the dynamics unfolding at every 
network node. Then, we apply a procedure for checking at what an extent they are determined by any structural 
property of the system. Therefore, we first identify the dynamical features that are affected by the network structure 
and thereafter probe the effect of a given set of structural measurements on those features (see supplementary Figure 
1). We found that the time signals are organized into well-defined patterns (see box for a simple example of structured 
dynamics), which is henceforth called structured dynamics. 

After the time signal Xi{t) at each node i is recorded along T consecutive discrete time instants (t = 1, 2, • • • , T), 
the PCA methodology can be applied in order to obtain linear combinations of the signal components (new random 
variables) that can be understood as new measurements PCA\^\PCAf\ . . . ,PCAf^'' {M < T) characterizing each 
individual signal i. These measurements are completely uncorrelated and correspond to respective projections of 
the original space along axes that are optimally aligned along the directions of maximum variation of the dynamics. 
Therefore, the PCA provides a compact and effective description of the original time signals. In case they are 
correlated, just a few principal axes are required for explaining the most relevant aspects of the original dynamics. 
The present work focuses attention on this category of dynamical systems. 

Having identified the most relevant aspects of the time signals, it is now important to check at what an extent each 
of the dynamical variables PCA^™) is being influenced by any of the structural aspects of the system under study. 
Thus, the method relies on no specific structural measurements whatsoever. First we assume that the time signal of 
a node i can be expressed as in Equation]] 

x,{t+\) = F{{x,{t)}), 

where j indexes the neighbors of i, and the initial condition is Xi(0) = Note that the system is Markovian, time 
invariant and that the dynamic function F is assumed to be identical at each of the network nodes. Therefore, the 
dynamics at a node i depends on three elements: (i) the function F , (ii) the initial condition ^, and (iii) the topology 
of the network, given by the adjacency matrix A. The null hypothesis is that the time signals cannot be discriminated 
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one another. The given network is subjected to a large number of simulations starting with different initial conditions 
^. Then, the density functions P(PCA("')) for each principal dynamical feature PCA'-"^^ are estimated and used as 
references. Thus, each of these density functions provides an estimate of the values obtained for the feature PCA^"^^ 
considering all the network nodes. Also, the individual density functions Pi{PCA'f^^) of the values of PCA'f^'^ are 
estimated considering each node i individually. In order to test whether the structural features produce distinct 
dynamical behavior at node level, we introduce the index, af^\ between P{PC A^™'^) and Pi{PC A'f^^), which is 
defined as the Euclidean distance between the respective densities. In other words, the value of expresses how 
much the node i deviates from the null hypothesis. In case af^'^ is significantly small, the dynamical property PCA^^^ 
at node i is understood not to be discriminated by any structural features, confirming the null hypothesis. 

For each dynamical feature PCA^™^ for which the null hypothesis is not verified, we then quantify how much 
it is related to each of a predefined set of structural measurements s^^\ s'^'^\ . . . , s'^^\ To do so, we calculate the 
dispersion of a along the measurement, weighted by its density. This is conveniently given by the conditional entropy 
(or equivocation [l3]) between s and a. 

In order to illustrate the proposed approach, we resort to three well-known types of dynamics in complex systems, 
namely integrate-and-fire [13 [T^], epidemics spreading (SIS) [T71[TH], and synchronization (Kuramoto oscillators) [T^ 
[21] (see the Box). Although the proposed methodology can be applied to any regime, we consider the steady-state 
values of the signals in the Erdos-Renyi (ER) model. 

We start by investigating the integrate-and-fire dynamics in which each node is understood as a neuron undergoing 
the McCulloch and Pitts integrate-and-fire dynamics [531 [53]. The binary time signal (firing spikes) of each node is 
recorded and represented as a vector. PCA is then applied over this ensemble of vectors to project the data onto 
the eigenvectors associated with the three largest eigenvalues. Figure |8]^a) shows the PCA projections of the time 
signals, with the colors corresponding to the node degrees (see also the supplementary Figure 2). Remarkably, the 
nodes resulted organized according to a well-defined geometrical pattern. Also shown in Figure [8] are the densities 
(Figs.|8|5,d) and average entropies (Figs.|8;,e) of the original signals after being further projected into two dimensions. 
Note that the 2D PCA projections include groups of nodes organized as 'cords' (see supplementary Figure 3). The 
obtained 3D projection can be divided into three main regions: (i) a relatively sparse conic 'head'; (ii) a densely 
populated 'waist'; and (iii) a relatively dense and complex 'tail'. We observe that the density peaks occur at low 
entropy places. This suggests that the system dynamics tends to unfold so as to favor more ordered (i.e. lower entropy) 
time signals. 

Another dynamical process considered in this paper is the Susceptible- Infected- Susceptible (SIS) model [24] that is 
used to investigate epidemics spreading on networked systems. For this dynamical process, the time series associated 
to each node is also binary. Figure [Sjjf ) shows the PCA projection of the SIS dynamics (node degrees mapped into 
colors), as well as the respective further two-dimensional projections into the PCA{1) x PCA{2) plane. The resulting 
PCA pattern is much simpler than that obtained for the integrate-and-fire dynamics, now containing just an eye- 
shaped volume. A cord can also be identified in this projection (see supplementary Figure 3). A similar trend is 
observed between the time signal density and entropy (Figure [8^, h). 

The third dynamics investigated in this work is the Kuramoto dynamics [20!. whose PCA projection is shown in 
Figurejsf^i), with the respective one-dimensional projection given in (j). It is clear from these results that the Kuramoto 
dynamics yielded the simplest PCA projection, in the sense that most of the signals variance is explained by PCA{1). 
We also found that the Kuramoto dynamics tends to yield cords which are related to the natural frequencies of the 
nodes, parametrized by the respective relative phases (see supplementary Figure 4). 

In the second step of our methodology, we evaluated the a[™'' for each of the new measurements PC^l'™-', as 
illustrated in Figures [9] The statistical significance of the a values was obtained by using a random null model 
(see supplementary Figure 5). First, several simulations were performed for varying random initial conditions ^, 
from which the reference histograms P{PCA''^^), P{PCA'-^^) and P{PCA'^^^)) in Figure [9|a-c) were obtained for the 
integrate-and-fire dynamics. These densities were also estimated for each node separately. For instance, in Figure 
[9|d-f), (g-i), and (j-1), we illustrate the densities of PCA''^\ PCA^'^^ and PCA^^\ respectively, for three randomly 
chosen nodes. The small values of a obtained in (g) indicate that this nodes is not being indistinctly influenced by 
any structural features of the network. On the other hand, larger values of a, such as those in (f,i,k,l) corroborate that 
the time signals at those respective nodes are greatly affected by the network structure. The overall a densities are 
shown in Figure [9|^m-o) for integrate-and-fire, (p,q) for SIS, and (r) for Kuramoto. Remarkably, the wide dispersion 
of a values obtained for most cases confirms that the structural influence on the dynamics can vary strongly from one 
node to another. It is also clear from these results that the PCA^'^^ of the integrate-and-fire dynamics, as well as the 
PCA^^^ of the SIS dynamics are the dynamical features mostly affected by the topology of the network. As expected, 
because of the adopted strong coupling, the Kuramoto dynamics resulted to be largely independent of the network 
structure, which was duly identified by the proposed methodology. This is confirmed by the rather small values of 
a shown in the density in Figure |9|^r) . A stronger influence of the topology was verified for a weaker coupling (see 
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supplementary Figure 6). 

We now proceed to the third step, obtaining scatterplots of the a'™) versus some topological measurements. The 
respective conditional entropies are then estimated in order to quantify the degree at which the a values are being 
explained by each of the measurements. The scatterplots respectively to the smallest conditional entropies (see 
Table|l| are depicted in Figure 10 In case of the integrate-and-fire dynamics (Fig. 10 i-c), we have that the eigenvector 
centrality was the topological feature that most strongly affected all the three principal component variables. As can 



be be seen in the scatterplot for a'^^^ versus EC (Fig. 10:), the influence of the topology on the PCA^^^ measurement 



is felt more strongly for the nodes with lower EC values. As shown in Figure 10 |d,e), respective to the SIS dynamics, 
the degree was the measurement most directly related to the two principal variables. Other measurements also were 
found to be related to the 2D PGA projections (see supplementary Figure 7). Remarkably, the values of a^^'^ and a^^^ 
present a low peak at values of degree similar to the average network degree {{k) — 10), meaning that both PCA(i) 
and PCA^"^^ variables of the SIS tend to feel the topology only for nodes with degree distinct from [k). Although the 
Kuramoto dynamics resulted unaffected by the network structure, the accessibility was the topological feature that 
yielded the smallest conditional entropy. 

All in all, we have proposed a new methodology for investigating the relationship between structure and dynamics 
in complex networked systems. The reported approach relies on two critical concepts, namely the consideration of 
the structure/dynamics relationship at the individual node level and also along different values of specific structural 
measurements. These concepts allowed the separation of the intermixing effects that would be otherwise obtained 
by using traditional approaches where both structure and dynamics are summarized in terms of global statistics. 
The obtained results corroborated the validity and importance of these hypotheses. Moreover, despite the uniformity 
of the ER topology, we identified a highly structured dynamics. In the case of the integrate-and-fire and the SIS 
dynamics, we found that the PCA regions with higher density of nodes tended to present low signal entropy, which 
suggests that the dynamics is related to signal uniformity. 



I. SUPPLEMENTARY MATERIAL 



A. Diagram 



The framework proposed in the present article for investigating the relationship between structure and dynamics 
in complex systems is summarized by the flow diagram in Figure [T] First, during the simulation stage, the original 
network is subjected to a total of Nc random initial conditions and the time signals for each node is recorded after 
the steady state has been reached. The next step involves the extraction of PCA dynamics features from the time 
signals. These features are then used to obtain the respective reference histogram. The Euclidean distances between 
this reference histogram and the node histograms are obtained and used to estimate the a values for each node with 
respect to each dynamical feature. Measurements Ti of the structure of the network are also estimated and used to 
obtain the scatterplots a x Ti. 

It should be observed that the orientation of the PCA axes is undetermined, because the negative of an eigenvector 
is also an eigenvector associated to the same eigenvalue. Therefore, in order to provide a stable reference, we obtained 
a set of eigenvectors for the large network (10000 nodes) and adopted then for all subsequent projections. 
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Method diagram 




FIG. 1: Flow diagram of the framework proposed in this article for investigating the relationship between structure and 
dynamics of complex systems. 



B. Integrate-and-Fire time signals 



The integrate-and-fire dynamics has been extensively investigated in complex systems because not only of its 
biological inspiration (i.e. as a simplified model of neuronal networks), but also as a consequence of its rich behavior [I]- 
[B^ . Though initial investigations focused on more regular topologies such as layered systems and lattices [7J |5j , much 
attention has been driven to the study of integrate-and-fire unfolding in complex networks [221 US]. Given that 
different network models are characterized by specific topological features, a fundamental question arises regarding 
the relationship between such structural properties and the respective dynamics. Remarkable related results have been 
obtained through the application of the methodology proposed in this article. Figure [2] shows the three-dimensional 
PGA representation of the integrate-and-fire dynamics unfolding in an ER network with 10000 nodes and average 
degree 10. The integrate-and-fire realization considered initial conditions drawn uniformly within the range [0, r -f 1], 
with r = 8. The time signals were recorded along 1000 steps after the system had reached steady state. 

The nodes were colored according to their degree, which resulted stratified along the PCA^^^ axis. Examples of 
respective time signals are shown on the righthand side of Figure [2j Interestingly, the time signals tended to be 
distributed along the PCA*^^^ axis in terms of their respective average frequency. The top of the PGA structure is 
populated by signals with maximum frequency, i.e. a firing spike at each time instant. The frequency decreases as one 
moves downwards along the PCA^^^ axis, such that the lowest frequency signals are found at the bottom (tail) of the 
PGA structure. The largest number of time signals (about 40%) were found to have average period of 2 cycles and 
to be distributed along the 'waist' of the PGA structure. As it becomes clear from Figure 3c, the time signals tended 
to be organized in groups with similar frequencies corresponding to integer number of cycles, in a way that reminds 
harmonic frequency distribution in a linear system. This finding implies that systems undergoing integrate-and-fire 
dynamics with similar parameters will have most neurons firing at 2 cycles, with the others tending to have multiple 
integer periods of oscillations. This interesting finding is related to the fact that the investigated dynamics in the 
ER structure tends to favor the uniformity of the time signals, as reflected in the respective entropy. Particularly 
remarkable is that such structured dynamics, including marked clusters of time signals, arose despite the structural 
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FIG. 2: (a) The 3d PGA projections of the integrate-and-fire dynamics unfolding in an ER network, (b) Examples of time 
signals obtained for the stratifications of the dynamics along the PCA*-^' axis. Observe that the frequency of the signals tends 
to decrease with lower values of PCA^^\ 



uniformity of the ER network. 
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Cords 



In order to explain the organization of signals along the cords in the PCA projections, we develop now a simple 
formulation for the values of PCA'-^' and PCA^^\ which we will call x and y for simplicity. First, let us assume we 
have the signal showed in Figure |3][a) , which can expressed as 



N 



= (1) 



where, N is the total number of spikes in the considered time interval, the i— th element of the v identifies the 
instant of the i—th spike. We can write the following rule for the elements of v 

2i-l if 1 < i < /i 

(2) 

2i iih<i< N. 

On the other hand, the first and second eigenvectors of the integrate- and- fire and SIS dynamics can be expressed 

as 

eiW = (-!)* (3) 

and 

e2W = (-l)*cos(^|), (4) 

where 1 < t < T, and T is the size of the time window. Therefore, we can estimate the values of x and y considering 
the inner-product of the signal and the respective eigenvector: 



x = (5) 

t=i 

and 

tlT 



y = ^(-l)*cos - .(t). (6) 
t=i ^ ^ 

Substituting Equation [TJ we find the PCA projections as a function of the hole position, h 

x{h) - 2{h + 1) (7) 



and 



i—h 



In Figure [sjjb) and [sjjc) we show the plot of y in terms of x (blue curves) for different values of h considering the 
integrate-and-fire and SIS dynamics, respectively. It is interesting to observe that if we consider the first element of 
the time signal as being zero (instead of one), the resulting curves corresponds to the red curves. 
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D. Phases in Kuramoto 



A different parametric configuration of the Kuramoto dynamics was used in order to further illustrate the potential 
of the PCA methodology in identifying meaningful properties of the dynamics. Three groups of nodes in an ER 
network with 1000 nodes were assigned specific natural frequencies, with weak coupling (A = 0.5). Figure |4]j a) depicts 
the 2D PCA projections obtained for the respective dynamics. The colors in this figure identify each of the frequency 
groups. Their respective projections are also shown in Figures [4] (b-d) . The colors in these three figures identify the 
relative phase of the time signals at each node. Figure [4]je) illustrates five characteristic time signals obtained along 
the cord in Figure |4j^d) . 
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FIG. 4: Illustration of the distribution of phases of the time signals along the cords yielded by the Kuramoto dynamics for an 
ER network with three frequency groups. 



E. Statistical Significance of a 



In order to obtain a level of statistical significance for the values of a produced by our simulations, we also consider 
the distribution of a values that would be obtained in the case of a random null model. In this model the value of 
a for each node was obtained by sampling, through Monte Carlo, Nc PCA features from the reference histogram. 
Figure [5] illustrates this approach with respect to the PCA^'^^ variable in integrate-and-fire dynamics. The histogram 
for the null model, shown in red, is well-fitted by a log-normal distribution. The histogram of a values obtained for 
the integrate-and-fire configuration is shown in gray. By comparing the latter histogram with the fitted log-normal 
distribution, it is possible to calculate the significance level assuming 0.001 confidence. In this specific case, we 
obtained a* = 0.053, which corresponds to the probability of obtaining a value of a larger than a* by chance. 
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Statistical significance of 




a'=0.053 

(significance level: 0.001 ; 



0.3 



0.4 



FIG. 5: Illustration of the construction used to obtain levels of statistical significance for the values of a. 



F. Effect of coupling in the Kuramoto dynamics 



To illustrate the proposed methodology, we considered in the main article a strongly coupled version of the Kuramoto 
oscillator. Here we provide complementary results with respect to a less intensely coupled configuration. Figures [6] 
(a) and (c) show the histograms of a obtained for this type of dynamics considering relatively weak (A = 1.75) and 
strong (A — 4.00) couplings. The histograms of a obtained for the null reference model are shown in Figures [6] (b) 
and (d), respectively. It is clear from these results that the values of a are substantially higher than those obtained 
for the null model in the case of the less strongly coupled Kuramoto simulations, while being undistinguishable in the 
more strongly coupled case. This means that in the less strongly coupled Kuramoto configuration the dynamics at 
each node is differentiated by the network structure, which is not observed in the other configuration. 
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FIG. 6: Effect of the coupling in the Kuramoto dynamics. As expected, a strong coupling makes the dynamics at each node 
not to be differentiated by any structural features of the network. 
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G. Topological measurements over the 2D PCA projection of the SIS dynamics 

So as to better understand the structure versus dynamics relationship in the SIS model, we mapped the values of 
the six considered specific topological features onto the 2D PCA projections obtained for this model, as shown in 
Figure [7] In each case, the projected points were separated into two main subsets: one corresponding to the border 
of the eye-shaped pattern (a 'chord') and the other to the remainder region. The histograms of the measurements 
for these two groups are also shown in Figure]?] respectively to each 2D projection. It is clear from these results that 
the time signals in these two groups tend to be well-separated with respect to their degree, eigenvalue centrality, and 
accessibility. More specifically, nodes with high values of these three measurements tend to be found along the chord. 
Given that low accessibility values have been found to be associated to the border of complex networks J5S], it is 
possible that the interior of the eye-shaped regions are occupied by the border nodes of the ER network adopted in 
our simulations. 




FIG. 7: 2D PCA projections of the time signals obtained for the SIS model colored in terms of the values of specific topological 
measurements (a-c, g-i) . Histograms of the values of the topological measurements considering the time signals separation into 
chord and interior regions (d-f,j-l). 
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TABLE I: The conditional entropies obtained for a considering the three dynamics in terms of some topological measurements: 
degree k, average neighbor degree knn, betweenness centrality BC, eigenvector centrality EC, average shortest path length 
ASPL and accessibility ACC. 



Principal component an* 
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The multivariate method /enown as Principal Component Analysis 
(PCA) [12] aims at removing redundancies from a data set through 
the complete decorrelation of the original measurements. This is 
performed &y rotating the coordinate axes so as to maximize rhe 
data dispersion along the first new axes or variables. Once the 
covariance of tf]e origir^ai data is estimated, its eigenvalues are 
calculated and placed in decreasing order. Tfjese values correspond 
to the variance along tfie new axes. The eigenvectors respective to 
the largest eigenvalues are them used to build a linear 
transformation matrix W that projects the data X Into the new 
coordinate system Y through linear combinations of the original 
measurements, with weights given by the eigenvector components. 



Structured dynamics 



Diffusion in complex netvjori^s corresponds tooneofthemostBasic^ 
and yet important, dynamics that can be investigated. The 
accompanying hgure shows the number of visits at each node 
(blacif curves) along time in the diffusion In the giant component of 
a directed macaque cortical network of 85 nodes [tSj, These curves 
tend to cluster into two well-defined groups of time signals The 
straight line in red corresponds to the average values of the number 
of visits along time. The vertical histogram depicts the final denstles. 
The obtained clusters provide the simplest example of structured 
dynamics. 



Adopted dynamics 



Integrdte-and-Fire: Each neuron i 
integrates the signal of its Incoming 
connections and fires whenever Its 
internal state, exceeds a threshold, t, 
which can be described as: 

where H h the Heavhide function. 




O S 'S p 




■E5 2E5 3E5 



Susceptible-lnfected-Susceptible: 

The model assumes that each node con 
be in two different states. Susceptible (S) 
or Infected il}. Each node in the state I can 
infect Its neighbors with probability p. 
Infected nodes can also become 
susceptible with probability [l. 



Kuramoto: ft describes the collective 
behavior of N coupled oscillators with 
intrinsic frequencies {i=1,...,N). The set 
of equations governing their phases 0, 
can be described as [?]: 



where "A. is the coupUng strenght. 
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FIG. 8: The 3d PCA projections of the considered dynamics, (a)integrate-and-fire, (f )SIS, and (i)Kuramoto. The percentage of 
explained variance provided by each principal component variable are shown along each axes. The densities of the projections 
are shown in (b,d) for the integrate-and-fire, (g) for the SIS, and (j) for the Kuramoto. The respective signal entropies are 
depicted in (c,e) for the integrate-and-fire, (h) for the SIS. All these results were obtained for an ER network with 10000 nodes 
and average degree of 10. The integrate-and-fire realization considered initial conditions drawn uniformly within the range 
[0,r-|-l], with T — 8. The SIS dynamics assumed (3 — 0.8 and fi = 1. The initial condition was such that 50% of the nodes were 
infected. The Kuramoto simulations were performed for k, — 4, with the natural frequencies drawn from a normal distribution 
with null mean and unit variance and the initial phases distributed uniformly between [0, 27r]. As shown in (b) and (d), the 
two extremities of the eye-shaped waist corresponds to approximately 40% of the nodes in the network. A third peak is found 
at the center of the 'eye', containing about 22% of the nodes. There is a fourth density peak, located along the central axis of 
the 'tail' part of the projection. Likewise, in (g) the time signals concentrate at the two extremities of the 'eye', corresponding 
to about 55% of the nodes. The number of PCA axes considered were either enough to account for at least 75% of the variance 
or limited to 3. 
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FIG. 9: Estimation of the distribution of a. The reference histograms of (a) PCA^^\ (b) and (c) PCA'^' for 1000 

reahzations of the integrate-and-fire dynamics over the ER network with 1000 nodes and average degree 10. Examples of 
histograms (considering the same realizations) for specific nodes with respect to the (d-f) PCA^^\ (g-i) PCA^'^\ and (j-i) 
PCA^^\ The histograms of (m) a'^^ (n) a'^' and (o) a''^' for the integrate-and-fire dynamics; (p) q^^\ (q) q'^-* for the SIS 
dynamics; and (r) a^^' for the Kuramoto dynamics. We used the same set of parameters as in Figure Isl 
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FIG. 10: Scatterplots between topological measurements and values of a: (a ) a'^> X EC, (b) q(^' X £;C, and (c) q^^^ x EC for the 
integrate-and-fire dynamics; (d) a'^' x k, and (e) a'^' x k for the SIS dynamics; and (f) a'^' x Acc for the Kuramoto dynamics. 
The red curve corresponds to the average of the a values, and bars indicate the standard deviation. Only the scatterplots 
obtained for the smallest conditional entropies in Table |l] are shown. 



